Image acquisition and exploitation camera system and methods therefore

ABSTRACT

A system for extracting, processing, and sending metadata associated with audio data and/or video data is described. In one embodiment, a system includes a sensor configured to acquire image data. A first electronic board with a processor is configured to control the sensor. A second electronic board that is configured to enrich the image data is operatively and removably coupled to the first electronic board.

RELATED APPLICATION

The present application is a continuation of U.S. patent applicationSer. No. 11/398,721, entitled “Image Acquisition and Exploitation CameraSystem and Methods Therefore,” filed on Apr. 6, 2006, which claimspriority to U.S. Provisional Patent Application No. 60/669,913, entitled“Image Acquisition and Exploitation Camera System,” filed on Apr. 11,2005, both of which are incorporated herein by reference in theirentireties.

FIELD OF INVENTION

The present invention relates to image and audio processing, and inparticular, but not by way of limitation, the present invention relatesto a system for extracting, processing and/or sending metadataassociated with images and/or sound.

BACKGROUND

Capture devices such as video recorders and still picture cameras cancapture, digitize, and store sound and/or images, but are typicallylimited in their ability to organize, process, and send the informationonce captured. In applications where, for example, distributed camerasare regularly capturing content, processing and organizing the capturedcontent can be important, particularly if specific portions of thecaptured content will be subsequently sent and/or retrieved.

Captured content can be organized and processed using post processingtechniques that include the extraction and association of metadata.Metadata can be defined based on the captured content, defined usingcollateral data, and associated with the captured content.

Metadata extraction and association, however, are typically notperformed in real-time or substantially real-time. Also, many of thecomponents used to perform the post-capture processing have life cyclesthat are much shorter than that of a typical capture device. Thus, aneed exists for an apparatus with interchangeable components and/orsubsystems that can extract, process and send, in real-time orsubstantially real-time, metadata associated with captured contentand/or the captured content.

SUMMARY OF THE INVENTION

In one embodiment, a system includes a sensor configured to acquireimage data. A first electronic board with a processor is configured tocontrol the sensor. A second electronic board that is configured toenrich the image data is operatively and removably coupled to the firstelectronic board.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a system block diagram of a camera system, according to anembodiment of the invention.

FIG. 2 is system block diagram of a camera system having a capturesubsystem, a central processing unit (CPU) subsystem, and a storagesubsystem, according to an embodiment of the invention.

FIG. 3 is a flowchart that illustrates a method for replacing anelectronic board within a camera system, according to an embodiment ofthe invention.

FIG. 4 shows a system block diagram of CPU subsystem, according to anembodiment of the invention.

FIG. 5 shows a camera system integrated into a broadcast facility,according to an embodiment of the invention.

DETAILED DESCRIPTION

In one embodiment, a camera system, which can also be referred to as animage acquisition and exploitation system, configured to extract,process, and/or send metadata associated with captured sound and/orimages (e.g., video) is described. The captured sound and/or images canbe referred to as content or captured content. The camera system notonly captures the sound and/or images, but also can extract and/orprocess metadata from the captured content. The camera system can makethe captured content and/or associated metadata available to a user forexploitation in substantially real-time. The extracting and/orprocessing of metadata from associated captured content can be referredto as enriching or indexing. The processing of captured content can bereferred to as manipulation.

In another embodiment, a camera system can include multiple distributedcapture devices that capture sound and/or images. These captured soundand/or images that can be enriched in distributed subsystems or in acentralized system containing multiple subsystems. The components and/orsubsystems included in a camera system can be interchangeable andcontained in one or more housings. For example, if applied in, forexample, a broadcast facility, content captured on different types ofmedia and transmitted using different methods can be centrally enriched.The centrally enriched content can be sent and/or retrieved with orwithout associated metadata for immediate use or further processing.Metadata is data about captured content that includes, for example,data, tags, annotations, and/or markings that can be associated withcaptured content. Metadata can be used to aid a user and/or a computersystem to, for example, index/organize/classify, retrieve and/or processcaptured content.

FIG. 1 is a block diagram of a camera system 100, according to anembodiment of the invention. The subsystems (e.g., CPU subsystem 120)and/or components (e.g., reticule 130) can be connected either by wiresor coupled wirelessly. The camera system 100 in FIG. 1 includes acapture subsystem 110 that acquires, for example, sound and/or imagesusing, for example, a sensor (not shown). The sensor can be, forexample, a still camera or a video camera that can include one or morelenses, charged-coupled device (CCD) chips, microphones, and/orprocessors. The capture subsystem 110 can also be referred to as avisual and audio capture subsystem. This subsystem 110 captures videoand/or audio that can be made available as data for processing (also canbe referred to as exploitation) by another subsystem. The capturesubsystem 110 can include an ordinary or sophisticated video or stillcamera with a video and/or audio output.

The camera system 100 in FIG. 1 also includes a central processing unit(CPU) subsystem 120 that can include any combination of processors,memory, video subassemblies and/or audio subassemblies. The CPUsubsystem 120 can also include a fixed or removable storage device (notshown) such as a hard disk or flash memory associated with, for example,an application-specific integrated circuit (ASIC) (not shown). Any ofthe components within the CPU subsystem 120 can be embedded in, forexample, an electronic board such as a motherboard. The CPU subsystem120 can process and be programmed with software applications such asmetadata engines that analyze, for example, images in real-time andextract information about content that has been acquired. The CPUsubsystem 120 can also include media-asset-management applications andpost-production applications for enriching captured content by indexing,manipulating and/or editing the content.

A reticule 130 is included in this camera system 100 for viewing imagesacquired by the capture subsystem 110. The reticule 130, which can bereferred to as a viewfinder, can be any kind of appropriate display. Thereticule 130 can also be used to aim, for example, a camera within thecapture subsystem 110 to capture video and/or audio. The reticule 130can also be used to display metadata generated by a metadata generationengine that is executed by, for example, the CPU subsystem 120. Thereticule 130 can display images already captured for the purpose ofmanipulating (e.g., editing) these images.

The camera system 100 also includes a fixed and/or removable storagedevice 140. The storage device can be, but is not limited to, a tape,DVD, DVC, flash memory, and/or hard disk. The storage device 140, forexample, can store applications used to execute metadata extractionengines, editing programs, and can store content that is acquired,generated, or processed by any of the subsystems. The camera system 100in FIG. 1 also includes a power supply 150 that can be, for example, arechargeable and/or replaceable power pack or packs that provide powerto the associated subsystems.

Camera system 100 includes a controller 160 that allow a user to controlsubsystems and/or manipulate audio and/or image signals/data. Forexample, the controller 160 can be used to control components withinsubsystems such as the zoom on a lens and/or camera system 100 on/offswitches. The controller 160 can also be configured to control camerasystem 100 functions such as marking shots and annotating content. Thecontroller 160 can be directly coupled to and can directly control aparticular subsystem within the capture subsystem 110.

Interfaces 170 are also included in this camera system 100 to attach,for example, external monitors, keyboards, mice or other input devicesusing tactile, audio or optical commands that allow for the content tobe identified and/or manipulated. Input and output (I/O) ports 180 canbe included as components of the camera system 100. I/O ports 180 can beused to couple to outside systems that, for example, load programs,data, executable commands into the camera system 100 and/or itssubsystems. I/O ports 180 can also be used to extract signals, content,and/or metadata from the camera system 100 to outside systems.

The subsystems and/or components of camera system 100 can be modular orinterchangeable to allow location in separate device/containers orwithin the same device/container. Such a device and/or container canalso be referred to as a housing. For example, in one embodiment, someof these subsystems and/or components can be located in a housing, whilethe remaining subsystems can be located near and outside of the housing.Such an embodiment can have, for example, subsystems including the CPUsubsystem 120 and its associated applications and software engines(described below) located within a housing while other components suchas storage devices 140 can be located with or worn by a user.

The subsystems (e.g., capture subsystem 110) and/or components (e.g.,power supply 150) can be included on separate electronic boards that areremovably coupled within, for example, a housing of a capture subsystem110. In some embodiments, the subsystems and/or components can beincluded on electronic boards in separate housings. Even if in aseparate housing the subsystems and/or components can be collectivelyreferred to as a camera system.

Although the components/subsystems can be in separate containers, thecomponents/subsystems are coupled in a mode that prevents degradedquality of the captured content or significant transmission delays thatwould defeat the advantages of substantially real-time exploitation. Inother words, the components/subsystems are coupled so that image and/orsound data can be transmitted between the components with, for example,minimal amounts of buffering or transmission delay. In some embodiments,the components/subsystems, although contained in different containers,can be connected using, for example, category-5 cable within an officecomplex.

FIG. 2 is system block diagram of an example embodiment of a camerasystem 200 that includes a capture subsystem 210, a CPU subsystem 270,and a storage subsystem 280. The capture subsystem 210 acquires imagesand/or sounds that are processed by the CPU subsystem 270. After the CPUsubsystem 270 processes the information, it is transmitted to thestorage subsystem 280. The subsystems within the camera system 200 canbe contained in separate housings.

The capture subsystem 210, also referred to as a visual and audiocapture subsystem, includes a CCD sensor 206, a set of lenses 204, and aprocessor 202. The CCD sensor 206 captures, through the lenses 204,visual information (e.g., video) that is converted into a digital data.The digital data is made available to a reticule 230 for viewing as araw (i.e. unenriched) picture. The capture subsystem 210 also includes asource audio input microphone 260 that digitally captures sound. Thecaptured digital audio and/or video data, which can be collectivelyreferred to as content, are made available to the CPU subsystem 270 forprocessing. The capture subsystem 210 can be any type of ordinary orsophisticated still camera or video recorder that can include anycombination of one or more lenses 204, CCD 206 sensors and/ormicrophones 260. In some embodiments, the video and/or audio captured bythe capture subsystem 210 can be analog signals that are converted intodigital signals/data.

The reticule 230 allows for viewing an image that is to be acquired andcan be used to aim the CCD sensor 206 and accompanying lens 204 in thecapture subsystem 210. The reticule 230 can be used for displayingmetadata generated by a metadata generation engine (not shown) withinthe CPU subsystem 270. The reticule 230 can also be configured todisplay images so that they can be processed (e.g., edited, annotated)by, for example, a user.

The storage subsystem 280 includes storage devices 282 that can beconfigured to send captured content (e.g., enriched and/or unenriched)via signals 244 to other systems (not shown) for, for example, furtherprocessing and/or distribution. The storage subsystem 280 can store rawcontent (i.e., unenriched content) or content that has been enriched(e.g., processed and associated with metadata) by the CPU subsystem 270.The storage devices 282 can be any kind of removable storage device.Data can be stored in the storage subsystem 280 in many formats or atmultiple data rates. Metadata can be permanently associated with thecontent (i.e., enriched content) or the content can be separated fromthe metadata when stored.

The camera system 200 in FIG. 2 also includes a lens and cameracontroller 208 that is associated with the capture subsystem 210. Thelens and camera controller 208, in this embodiment, interfaces withprocessor 202 to control, for example, the zoom of the lens 204. Thelens and camera controller 208 is used to turn the entire camera system200 on and off. In some embodiments, the lens and camera controller 208can be configured to turn only a portion of the camera system 200, suchas the capture subsystem 210, on and off.

The camera system 200 includes a CPU controller 226 that can be used tocontrol the CPU subsystem 270. For example, the CPU controller 226 canbe configured to allow, for example, a user to edit content acquired bythe capture subsystem 210. In some embodiments, controls that areassociated with other subsystems and/or combinations of subsystems canbe used to control any function associated with the camera system 200.For example, a separate control device can be used to mark shots andannotate content.

The CPU subsystem 270 includes a processor 272 and a database 274. TheCPU subsystem 270, processes the digital signals produced by the capturesubsystem 210 using the processor 272. The processor 272, for example,executes applications for manipulating content captured by the capturesubsystem 210. The database 274 can be accessed and used by, forexample, applications executed by the processor 272 during theprocessing of captured content. A more detailed example of a CPUsubsystem 270 is shown in FIG. 4.

Referring back to FIG. 2, the capture subsystem 210, the CPU subsystem270, and the storage subsystem 280 are separate subsystems that can beincluded as removably coupled subsystems on, for example, separateelectronic boards in a single housing or in separate housings. Forexample, the CPU subsystem 270 and associated components can be includedon a motherboard that is in the same housing as a separate motherboardfor the capture subsystem 210.

The subsystems of camera system 200, as discussed above, can be locatedeither in separate containers (e.g., device housing) or within the samecontainer. For example, the CPU subsystem 270 can incorporated into anexisting capture subsystem 210 housing that includes, for example, anoff-the-shelf (OTS) optical camera. The existing capture subsystem 210can be retrofitted with the CPU subsystem 270. Retrofitting includesre-programming components on, removing components from and/or addingcomponents to the CPU subsystem 270 so that the CPU subsystem 270 iscompatible with the existing capture subsystem 210. The CPU subsystem270 can also include OTS components. Other components such as thestorage subsystem 280 can be located nearby or can even be worn by acamera operator. This camera system 200 embodiment can haveapplications, for example, in the broadcast, military and securityindustries.

The camera system 200 includes an input and control microphone 250 thatcan receive commentary from, for example, a camera system operatorassisting in the identification of shots and/or describing the content.The input and control microphone 250 can also receive voice commands forthe operation of the camera system 200 and/or for the manipulation ofthe content. Audio input captured by a camera system operator using theinput and control microphone 250 can also be analyzed to extractmetadata for enriching (e.g. full indexing).

The camera system 200 also includes several inputs and outputs from thesubsystems and components. The figure shows that raw data 240 from theCCD sensor 206 can be accessed from the capture subsystem 210, forexample, by a system (not shown) that is not part of the camera system200. The figure also illustrates that collateral data 224 can be inputinto and an output signal 232 can be extracted from the CPU subsystem270. Collateral data includes 224, for example, additional markingand/or annotating data that can be used by the CPU subsystem 270 toprocess image and/or sound data.

The output signal 232 can be a processed signal that contains audioand/or video with associated metadata (i.e., enriched data). The outputsignal 232 can be transmitted at a single or variable rate. Outputsignals 244 from the storage devices 282 within the storage subsystem280 allow the downloading of the stored content and/or associatedmetadata into asset-management (not shown), archiving (not shown), orlibrary systems (not shown). The data signal 228 is a bidirectionalsignal that allows for the loading of data into the camera system 200necessary for metadata extraction and for the population of externaldatabases with data (e.g., audio and/or images) acquired using thecamera system 200. In other embodiments, other I/O ports (not shown) canbe used to allow programs, data, executable commands to be loaded intothe camera system 200 and its subsystems, and to extract a variety ofsignals, content, and/or metadata out of the camera system 200.

In some embodiments, a rechargeable and or replaceable power pack orpacks (not shown) can be used to provide power to any of the subsystemswithin the camera system 200. In yet other embodiments, interfaces andports (not shown) for attaching external monitors, keyboards, mice orother input devices using tactile, audio or optical commands can be usedto allow for capture content to be identified and/or manipulated.

FIG. 3 is a flowchart that illustrates a method for replacing, within acamera system, a first electronic board with a third electronic board(also can be referred to as a replacement board), according to anembodiment of the invention. The first electronic board that is beingreplaced is coupled to a second electronic board (also can be referredto as a retrofitted electronic board). The first electronic board andthe second electronic board are contained in the same housing. Thesecond electronic board can be, for example, a motherboard for a capturesubsystem and the first and third electronic boards can be, for example,a CPU subsystem motherboard and a replacement CPU subsystem motherboard,respectively. Alternatively, in some embodiments, the retrofittedelectronic board can be contained in a different container/housing asthe electronic board that is being replaced.

As shown in FIG. 3, the first electronic board is decoupled from thesecond electronic board at 300. A display, a controller, and a storagesubsystem are all decoupled from the first electronic board at 310, 320,and 330, respectively. The third electronic board is then coupled to thesecond electronic board at 340. The display, controller, and storagesubsystem are all coupled to the third electronic board at 350, 360, and370, respectively. When the first electronic board is replaced by thethird electronic board, the second electronic board, display,controller, and storage subsystem, etc. are retrofitted with the thirdelectronic board. Retrofitting can include, for example, one or more ofprogramming components on, removing components from and/or addingcomponents to the third electronic board so that the third electronicboard is compatible with each of the components/subsystems to which thethird electronic board is coupled.

Although FIG. 3 shows that the first electronic board is decoupledfirst, the display is decoupled second, the controller is decoupledthird, etc., the subsystems/components can be decoupled and coupled inany order in other embodiments. For example, in some embodiments, thedisplay can be decoupled from the first electronic board and coupled tothe third electronic board before the first electronic board isdecoupled from the second electronic board. Also, in some embodiments,other components and/or subsystems, such as a power supply, can beretrofitted with a replacement electronic board.

FIG. 4 is an example of a CPU subsystem 400 that executes varioussoftware applications including an operating system 430 andapplications. Such applications can be, for example, third-partyapplications (i.e., off-the-shelf applications). The applications caninclude, for example, metadata extraction engines 440 (e.g., Virage'sVideologger and/or Audiologger), digital-asset-management 450 (e.g.,Artesia Technologies' Digital Asset Management (DAM)) and browsing andediting programs 460 (e.g., Apple's Final Cut Pro). The CPU subsystem400 can be configured to use many types of off-the-shelf (OTS) software,for example, security software that includes moving object, gate, and/orobject analysis (e.g., Cemium Perceptrak). These programs can be used tomanipulate captured content on-demand using input devices such as, butnot limited to, a keyboard (not shown), a mouse (not shown), or by usingvoice or optical commands (not shown). The manipulated and/or rawcontent can be displayed through a reticule (not shown) or through anoutside device such as a monitor (not shown). The applications can beexecuted on one or more processors (not shown) within the CPU subsystem400. Processors within the CPU subsystem 400 can be specialized modules(e.g., ASICS or digital signal processors) dedicated to performingspecific functions such as metadata extraction.

Collateral data 420, which can also be referred to as customizable data,such as date, time, camera properties, GPS etc. can also be received bythe CPU subsystem 400. Other collateral data 420 such as clip markinggenerated by applications and/or hardware from manufacturers (e.g.,Sony) can also be entered into the CPU subsystem 400.

Signals received by the CPU subsystem 400 such as audio and/or videosignals 404 are received and processed using the applications describedabove. The audio and/or video signals 404 can be received from, forexample, a capture subsystem (not shown). The processing of the audioand/or video signals 404 within the CPU subsystem 400 is managed by adigital-asset-management application 450. The digital-asset-managementapplication 450 can send and/or receive raw and/or enriched content fromthe metadata extraction engine 440 and/or the browse and editapplication 460. The digital-asset-management application 450 can alsosend raw and/or enriched content as an output signal 490 and/or as anoutput to a storage subsystem 480.

The metadata extraction engine 440 provides analysis of the audio/videosignal 404 by extracting information about the content such as faces,words, keyframe information through speech to text conversion, speakeridentification, visual properties face recognition, voice recognition,optical character recognition (OCR), and other characteristics andattributes. The method of extraction, amount of information andreliability of the extracted data depends on the particular metadataextraction engine 440. The metadata extraction engine 440 produces ahigh-resolution indexed data stream and a low-resolution proxy datastream. These streams can be provided to the storage subsystem 480, canbe output as a signal 490, and/or can be output to the browse-and-editapplication 460. The metadata extraction engine 440 can also generatecontent at multiple data rates and multiple resolutions. Lower rates canbe used for searching and browsing. A lower rate system output reducesthe required average bandwidth for transmitting the content, raw orindexed.

The browse-and-edit application 460 can be manipulated by, for example,an operator using a control console (not shown). Content that is editedby the browse-and-edit application 460 can be transmitted with orwithout associated metadata as an output signal 490 and/or to thestorage subsystem 480 via the digital-asset-management application 450.The content-based metadata or any other data stream can also bedisplayed on a reticule (not shown). The reticule can also be used tomonitor the manipulation of data when editing.

Metadata extracted from captured content and/or raw (i.e., original)content can be stored in, for example, a storage subsystem (not shown)or in database 470. The data can be stored in one or more formats. Insome embodiments, the metadata can be permanently associated with thecaptured content. The captured content and/or metadata can be stored atmultiple data rates. The captured content can be separated from themetadata and stored as raw (i.e., original) content.

FIG. 5 shows a camera system used in conjunction with a typicalbroadcast facility 550. The figure shows examples of the signals thatflow within the typical broadcast facility. The system block unitidentified as videotapes 500 can include for example, but is not limitedto, a digital video disc (DVD), a digital video cassette (DVC), flashmemory and/or a hard disk. The videotapes 500 can be transmitted via awireless connection, a universal serial bus (USB) connection, and/or afirewire connection.

FIG. 5 shows the system block units automated metadata extraction 510,ingestion application 520 and manual logging & indexing 530. Each ofthese system block units represent one or more applications that can beexecuted within, for example, a CPU subsystem within a camera system asdescribed above in reference to FIGS. 1-4. In this embodiment shown inFIG. 5, the system block units can be internal to the broadcast facility500 and process image and/or sound data to produce any combination ofraw or enriched content. In other embodiments, the system block unitscan be located internal to or co-located with the camera system inaddition to being located at the broadcasting facility. Thus, the camerasystem discussed above in reference to FIGS. 1-4 can be used withexisting broadcast facilities and can provide some of the broadcastfunctionality at the camera system.

In conclusion, among other things, a system for extracting, processing,and sending metadata associated with audio data and/or video data isdescribed. While various embodiments of the invention have beendescribed above, it should be understood that they have been presentedby way of example only, and various changes in form and details may bemade. For example, the camera system can be used in many applicationssuch as, for example, security and military applications.

1. A modular system for facial recognition, comprising: a containercomprising: a visual sensor configured to acquire image data including aface; and a first electronic board including a first processor tocontrol the sensor; a portable housing, operatively and removablyconnected to the container by a cable or wirelessly, comprising astorage subsystem including a database of metadata relating to faces; aface recognition electronic board including a second processor used toextract and associate metadata in substantially real-time, whereininformation about faces is extracted from the acquired image data andassociated with the acquired image data as metadata about faces, theface recognition electronic board is in communication with the firstelectronic board and the storage subsystem; and a display devicedirectly connected to at least one of the container and the portablehousing, the display device receiving data and displaying data insubstantially real-time from at least one of the first electronic boardand the face recognition electronic board, wherein the acquired imageand results of the metadata extraction and association including facerecognition are simultaneously shown in substantially real-time on thedisplay device; wherein the container, the portable housing and thedisplay device are modular components with connectors.
 2. The system ofclaim 1, further comprising: a controller coupled to the facerecognition electronic board, the controller receives an input, thecontroller controls the enriching of the image data by the secondprocessor based on the input.
 3. The system of claim 1, wherein the facerecognition electronic board receives at least one of a collateral dataor an audio signal from a microphone.
 4. The system of claim 1, whereinthe second processor performs in substantially real-time facerecognition.
 5. The system of claim 1, wherein the second processorproduces a high-resolution indexed data stream and a low-resolutionproxy data stream.
 6. The system of claim 1, wherein the secondprocessor generates content at multiple data rates and multipleresolutions.
 7. The system of claim 1, wherein the second processorperforms in substantially real-time visual properties recognition. 8.The system of claim 1, wherein the second processor performs insubstantially real-time voice recognition and speaker identification. 9.The system of claim 1, wherein the second processor performs insubstantially real-time words and optical character recognition.
 10. Thesystem of claim 1 wherein the second processor performs in substantiallyreal-time speech to text conversion.
 11. The system of claim 1, furthercomprising a second camera, wherein the second camera is attached to thehousing, wherein image data from the first and second camera areprocessed substantially simultaneously by the second processor.
 12. Thesystem of claim 1, further comprising an audio sensor to acquire audiodata, wherein the first processor receives the audio data from the audiosensor, the second processor enriches the audio data in substantiallyreal-time.
 13. A modular system for facial recognition, comprising: acapture subsystem, housed in a container, having a sensor configured tocapture visual content, the captured visual content including a face; aportable housing, operatively and removably connected to the containerby a cable or wirelessly, including a storage device wherein a databaseof metadata relating to face recognition is stored; a central processingunit (CPU) subsystem wherein metadata is both extracted from thecaptured visual content and associated with the captured visual contentin substantially real-time, the CPU subsystem communicating with thehousing, and the CPU subsystem processing the associated metadatarelating to face recognition and visual content using a digital assetmanagement application; and a display device, connected to the housing,the display device receiving and displaying metadata in substantiallyreal-time, wherein the results of the metadata extraction andassociation include face recognition and are displayed in substantiallyreal-time; wherein the container, the portable housing and the displaydevice are modular components with connectors.
 14. The system of claim13, further comprising: a CPU controller which receives an input, theCPU controller controls a function associated with the CPU subsystembased on the input.
 15. The system of claim 13, further comprising: acontroller which receives an input, the controller controls a functionassociated with the capture subsystem based on the input.
 16. The systemof claim 13, further comprising a second camera, wherein the secondcamera is attached to the housing, wherein image data from the first andsecond camera are processed substantially simultaneously by the CPUsubsystem.
 17. The system of claim 13, wherein the CPU subsystemreceives at least one of a collateral data or an audio signal from amicrophone.
 18. The system of claim 13, wherein the CPU subsystemgenerates content at multiple data rates and multiple resolutions. 19.The system of claim 13, further comprising an audio sensor to acquireaudio data, wherein the CPU subsystem receives the audio data from theaudio sensor and enriches the audio data in substantially real-time. 20.A method of changing a camera in a modular facial recognition systemcomprising: connecting a first camera system module which capturesimages of faces in a first format to a CPU system and a storage deviceusing a peripheral device connection, wherein the CPU system extractsand associates metadata in substantially real-time and wherein thestorage device is portable and stores metadata for facial recognition;coupling a display device to the CPU system and storage device whereinthe display device displays in substantially real-time face recognitionmetadata simultaneously with captured images of faces; disconnecting thefirst camera system from the peripheral device connection; connecting asecond camera system which captures images of faces in a second formatto the CPU system and storage device; and enriching the audio data insubstantially real-time, wherein when the first and second camera areboth connected to the system the captured images of faces from the firstcamera and the captured images of faces in the second format from thesecond camera are processed substantially simultaneously by the CPUsystem.
 21. The method of claim 20, further comprising: connecting athird camera to the CPU system and storage device wherein image datafrom the second and third camera are processed substantiallysimultaneously by the CPU system.
 22. The method of claim 20, whereinthe peripheral device connection is one of a universal serial bus, afire wire, a category-5 cable, or wirelessly.
 23. The method of claim20, further comprising acquiring audio data using an audio sensor.